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(57) ABSTRACT 

A de -blocking method and apparatus in which a block 
classifier determines whether the received decoded image is 
a planar surface or a complex surface. A first correction 
value calculator calculates correction values for block 
boundary pixels using a first filtering coefficient when the 
decoded image is a planar surface, an interpolator provides 
first correction values for pixels on the block boundary, and 
a second correction value calculator calculates second cor- 
rection values for some block boundary pixels using a 
second filtering coefficient when the decoded image is a 
complex surface. A corrector provides a corrected image by 
correcting the received decoded image using the first cor- 
rection values when the received decoded image is a planar 
surface, or using the second correction values when the 
received decoded image is a complex surface. Blocking 
artifacts are effectively removed to prevent discontinuity 
between boundaries of the decoded image obtained by 
decoding a block-based coded image, while maintaining the 
edge and the texture of the image. 

22 Claims, 4 Drawing Sheets 
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FIG. 3 
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de-bijOCKING method and apparatus 
background of the invention 

L Field of the Invention 

The present invention relates to the improvement of 
image quality, and more particularly, to a method and 
apparatus for efifectively removing a blocking artifact occur- 
ring during block-based coding. 

2. Description of the Related Art 

In recent apparatuses for coding and transmitting video 
and/or audio signals or decoding the same, a block-based 
transform coding method is widely used However, this 
block-based transform coding method leads to degradation 
of the image quality since an increase in the compression 
rate of an image causes a blocking artifact. This is because 
the loss of transform coefBcients is not accurately compen- 
sated for in the course of independent quantization of each 
block during decoding. 

In FIG. 1, a flowchart for illustrating a conventional 
de-blocking method, a decoded image obtained by decoding 
^a block-based coded image is received in step SlOl, and the 
degree of a blocking artifact is estimated using pixels 
existing at the block boundary of the received decoded 
'image, in step S102. Here, a typical blocking artifact essti- 
mation is made by using a value obtained by averaging the 
squared dififerences between pixel values at the blocking 
boundary. The magnitude of a blocking artifact is reduced by 
correcting the decoded image using an estimated value to 
determine the degree of the blocking artifact in step S102, 
and a corrected image is thus provided, in step S103. The 
degree of de-blocking with respect to the corrected image is 
determined in step SI 04. If the blocking artifact is satisfac- 
torily removed, a de -blocked decoded image is output, in 
step SI 05. Otherwise, step S102 is performed again to repeat 
the above steps. 

Conventional de-blocking methods can be classified into 
repetitive methods of repeating the de-blocking process as 
shown in FIG. 1, and non-repetitive methods. In repetitive 
de-blocking methods, there is a projection onto convex sets 
(POCS) method for obtaining a more natural image by 
repetitively projecting a decoded image onto convex sets by 
utilizing the advance knowledge of the smooth characteris- 
tics and coefBcient range of an original image for post- 
processing. A duplicate transform method, for reducing the 
discontinuity at the block boundary by allowing a small 
amount of overlap between blocks during coding and 
decoding, is also a repetitive de-blocking method. These 
repetitive de -blocking methods have a high de-blocking 
performance, but requke very large amounts of calculation 
such that it is diflBcult to use these methods for real time 
applications or reahze them as hardware. 

The discontinuity at the block boundary locally has a 
waveform similar to a staircase wave, and this denotes 
generation of many high-frequency components in the fre- 
quency domain. Therefore, a non-repetitive de -blocking 
method, such as, a low-pass filtering on boundaries for 
reducing the blocking artifact by removing high frequency 
components by low-pass filtering pixels on block 
boundaries, is very simple but does not have a high 
de-blocking performance. 

SUMMARY OF THE INVENTION 

To solve the above problems, it is an objective of the 
present invention to provide a high performance non- 
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repetitive de-bloddng method and apparatus which can be 
applied in real time. 

It is another objective of the present invention to provide 
a de -blocking mettrad and apparatus to prevent discontinuity 
5 between boundaries of a decoded image obtained from a 
block-based coded image while maintaining the edge and 
the texture. 

Accordingly, to achieve the above objectives, there is 
provided a de-blocking method of de-blocking a decoded 
image obtained by decoding a block-based coded image, the 
method comprising the steps of: (a) obtaining a first correc- 
tion value by filtering pixels on a block boundary of the 
received decoded image using a first filtering coefficient 
corresponding to the case when the decoded image is a 
planar surface; (b) obtaining a second correction value by 
filtering pixels on a block boundary of the received decoded 
image using a second filtering coefficient corresponding to 
the case when the decoded image is a complex surface; and 
(c) providing a corrected image by correcting the received 
decoded image using the first correction value when the 
decoded image is a planar surface or using the second 
correction value when the decoded image is a complex 
surface. 

To achieve the above objectives, there is provided a 
de-blocking apparatus for de -blocking a decoded image 
obtained by decoding a block-based coded image, the appa- 
ratus comprising: a block classifier for determining whether 
the received decoded image is a planar surface or a complex 
surface; a first correction value calculator for calculating 
correction values for block boundary pixels by filtering the 
block boundary pixels of the received decoded image using 
a first filtering' coefficient when the decoded image is a 
planar surface; an interpolator for providing first correction 
2^ values for pixels on the block boundary and within a block 
by bilincarly interpolating the pixels within a block using the 
correction values for the block boundary pixels; a second 
correction value calculator for calculating second correction 
values for some block boundary pixels by filtering the block 
boundary pixels of the received decoded image using a 
second filtering coefficient when the decoded image is a 
complex surface; and a corrector for providing a corrected 
image by correcting the received decoded image using the 
first correction values when the received decoded image is 
a planar surface or the second correction values when the 
received decoded image is a complex surface. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The above objectives and advantages of the present 
50 invention will become more apparent by describing in detail 
a preferred embodiment thereof with reference to the 
attached drawings in which: 

FIG. 1 is a flowchart for illustrating a conventional 
de-bloddng method; 

FIG. 2 is a block diagram of a de-blocking apparatus 
according to an embodiment of the present invention; 

FIG. 3 is a graph showing an example of correction of two 
straight lines for securing continuity at a block boundary; 

60 

FIG. 4 is a flowchart for illustrating a de-blocking method 
according to an embodiment of the present invention. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

65 

Referring to FIG. 2, a de-blocking apparatus according to 
an embodiment of the present invention includes a block 
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classifier 202, a first correction value calculator 204, a 
two-dimensional (2-D) interpolator 206, a second correction 
value calculator 208, a selector 210, and a corrector 212. The 
block classifier 202 determines whether the block for an 
input decoded image is a planar surface or a complex 5 
surface. The first correction value calculator 204 filters the 
received decoded image using a first filtering coefficient for 
a planar surface to dc -block pixels on a boundary. The 2-D 
interpolator 206 de-blocks pixels within the block of a 
planar surface. The second correction value calculator 208 lo 
filters the received decoded image using a second filtering 
coefficient for a complex surface to de-block some pixels on 
the block boundary. The selector 210 selects the output of 
the 2-D interpolator 206 if the decoded image classified by 
the block classffier 202 is a planar surface, or selects the is 
output of the second correction value calculator 208 if the 
decoded image classified by the block classifier 202 is a 
complex surface, and provides the selected output to the 
corrector 212. The corrector 212 corrects a block artifact by 
applying the correction value selected by the selector 210 to 20 
the pixel value of the received decoded image. 

The operation of the apparatus of FIG, 2 will now be 
described in more detail referring to FIG. 3. 

First, the block classifier 202 receives a decoded image 
obtained by decoding a block-based coded image and clas- 
sifies blocks using the 2-D discrete cosine transform (DCI^ 
coefficients of the decoded image blocks. That is, if a 
non-zero coefficient is included in the coefficients except for 
three coefficients having the lowest frequencies, i.e., a DC 
coefficient and AC coefficients at positions (0,1) and (1,0), 
among DCT. coefficients, the block of the decoded image is 
classified as a complex surface. Otherwise, the blodc of the 
decoded image is classified as a planar surface. The block 
classifier provides a classification control signal to the 
selector 210. 

Assuming that horizontal pixels over two blocks are A7, 
A6, A5, A4, A3, A2, Al, AO, BO, Bl, B2, B3, B4, B5, B6 and 
B7, a block boundary exists between AO and BO. On the 
assumption that 16 pixels exist along a boundary (16 pixels 
are assumed since 88 blocks are typically xised for DCT), the 
first conection value calculator 204 obtains a correction 
value for pixels AO and BO corresponding to the block 
boundary as shown in FIG. 3 using the first filtering coef- . 
ficients for a planar surface. That is, the correction value for 
boundary pixels AO and BO is calculated by filtering four 
pixels Al, AO, BO and Bl on the boundary using the first 
filtering coefficients. The first filtering coefficient for a 
planar surface is given as follows: 

filtering coefficient for AO/BO: -/+(l/4, -3/4, -1/4, 3/4]. 

Here, a negative sign (-) is applied to the calculated 
correction value for AO, and a positive sign (+) is applied to 
the calculated correction value for BO. That is, the results of 
filtering using the first filtering coefficient denote a discon- ss 
tinuity value (A) on the block boundary of FIG. 3. A 
discontinuous boundary can be corrected by subtracting A 
from pixel AO of the received decoded image and adding A 
to pixel BO of the received decoded image. Thus, the 
discontinuity value A, obtained by filtering using the first 60 
filtering coefficient is necessary for continuously connecting 
two straight lines to each other on the block boundary, on the 
assumption that AO and Al form one straight line and BO and 
Bl form another straight line. 

In the case of a planar surface, two boundaries exist on the 65 
horizontal line boundary of one block. That is, in the case of 
16 pixels as described above, the space between AO and BO 



corresponds to one block boundary, and another boundary 
exists between A8 and B8. Accordingly, the 2-D interpolator 
206 performs bilinear interpolation using the correction 
value for boundary pixels calculated by the first correction 
value calculator 204, thereby de-blocking pixels within a 
block. That is, the first correction value calculator 204 
corrects planar surface pixels on block boundaries, and the 
2-D interpolator 206 corrects planar surface pixels within 
each block. 

The second correction value calculator 208 filters some 
pixels (e.g., Al, AO, BO and Bl) on block boundaries of the 
received decoded image using second filtering coefficients 
for a complex surface. Hie second filtering coefficients are 
given as follows: 

filtering coefficient for AO/BO: -/+{l/8, -3/8, -1/8, 31/8], 
filtering ooeffiricnt for Al/Bl:+/-[ 1/24, -1/8, -1/24, 1/8]. 

That is, the correction values of AO and BO for a complex 
surface are calculated by using a filtering coefficient half the 
size of the first filtering coefficient for a planar surface, 
wherein a negative sign (-) and a positive sign (+) arc 
supplied respectively to the correction value for AO and the 
correction value for BO. The correction values of Al and Bl 
are calculated using a filtering coefficient one third the size 
of the filtering coefficient for AO and BO, wherein a positive 
sign (+) and a negative sign (-) are supplied respectively to 
the correction value for Al and the correction value for Bl. 
Since both the first filtering coefficient for a planar surface 
and the second filtering coefficient for a complex surface are 
negative and positive integers,- the correction values are 
simply calculated, and the loop filter configuration of the 
first and second correction value calculators 204 and 208 
becomes simplified. 

The selector 210 supplies the correction value for each 
corrected pixel on block boundaries and within blocks, 
output from the 2-D interpolator 206, to the corrector 212 if 
the decoded image classified by the block classifier 202 is a 
planar surface, or the selector 210 supplies the correction 
values for some pixels on the block boundary output from 
the second correction value calculator 208 if the classified 
decoded image is a complex surface. The corrector 212 
provides a corrected image by adding a correction value 
selected by the selector 210 to the received decoded image. 

In the de-blocking apparams of the present invention, the 
first and second correction value calculators 204 and 208 
calculate sign-free correction values, while the sign for a 
calculated correction value is given by the corrector 212. 

In FIG. 4, a flowchart for illustrating a de-blocking 
method according to an embodiment of the present 
invention, a block-based coded decoding image is received 
in step S201. It is determined whether the received decoding 
image is a planar surface or a complex surface, in step S202. 
When the decoding image is a planar surface, the correction 
values for pixels on block boundaries are calculated by 
filtering the pixels on the block boundary using the first 
filtering coefficient, in step S203. When the decoded image 
is a planar surface, pixels within blocks are two- 
dimensionally interpolated using a bihnear interpolation 
method, in step S204. The correction values for pixels on the 
block boundary and within a block are all provided. 

Meanwhile, when the decoding image is classified as a 
complex surface in step S202, the correction values for some 
pixels on the block boundary are calculated by filtering the 
pixels on the block boundary using the second filtering 
coefficient, in step S206. The thus-calculated correction 
values are added to the decoded image, and a corrected 
image is thus provided, in step S205. 
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The present inveation is applicable to all kinds of block- (b), and wherein the second filtering coefiBcient for obtaining 

based image coding systems based on DCT, Le., coding second correction values of boundary pixels AO and BO is 

systems which use image compression standards such as smaller than the first filtering coefiBcienl, and wherein the 

H.26x recommended by the Joint Photographic Experts second filtering cocfGcicnt for obtaining second correction 

Group (JPEG), the Moving Picture Experts Group (MPEG), s values of other boundary pixels Al and Bl is smaller than 

and the International Telecommunication Union- the second filtering coefficient for obUining second correc- 

TelecommumcaUon StandardizaUon Sector (IW-T). ^^^^ values of boundary pixels AO and BO. 

In particular, the present mvenUon can be highly efifective g ^.t^od of claim 5. wherein the second filtering 

when used m an image coding system havmg an environ- coefficient for obtaining second correction values for the 

ment in which a very high compression rate is required due boundary pixels AO and BO is [1/8, -3/8, -1/8, 3/8], a 

to the restricted band of a transmission channel. That is, the negative sign and a positive sign being assigned to the 

present invention can be applied to image telephone systems second correction values for AO and BO re^ectivcly, the 

which have degradation of miagc quality because of the ^^^^^^ filtering coefficient for obtaining second correction 

JPEG image service provided by the Internet and the values for the boundary pixels Al and Bl being [1/24. -1/8, 

restricted band of a telephone wire. Thus, the quality of ,5 ygj^ ^ ^^^^^^^ ^^^^ , ^^^^^^^ ^^g^ ^eing 

image mformation provided by the Internet can be improved assigned to the second correction values for Al and Bl 

for a received image, and satisfactory picture quality within respectively 

a restricted band can be received during video telephone 7 j^ethod of claim 1, wherein step (c) further 

calls. In addition, the present invention is appUcable to low comprises a step (cl) of determining whether the received 

bit rate coding systems which are expected to be applied to j^^oded image is a planar surface or a complex surface, 

very wide-ranging fields in the future. g ^i,^ ^^^^^ of ^^^^^ 7^ therein in step (cl); the 

As described above, the present invention can be applied determination of whether the received decoded image is a 

in real time, and is easily realized as hardware by removing pi^nar surface or a complex surface is made using a DC 

a blockmg artifact using a non-repetjtivc and simple mteger coefficient and at least some low-frequency coefficients 

anthmetic operation. Also, the present invenUon can efifec- ^5 among discrete cosine transform coefficients for decoded 

tively remove the blocking artifact to prevent discontinuity image blocks 

between boundaries of a decoded image obtained by decod- 9. A de-blocking method of de-blocking a decoded image 

mg a block-based coded image, whUe maintammg the edge obtained by decoding block-based coded image, the method 

What ^rdaTmed is- comprising the steps of: 

la' delloTkfnf method of de-blocking a received iTarsurf^ce"^*"''^ '^"^^'"^ '^''^^''^ ^ ' 

decoded image, obtained by decoding a block-based coded ^ * 

image, the method comprising the steps of: obtaining correction values for pixels on a block 

(a) obtaining first correction values by filtering pixels on boundary and within a block by filtering block bound- 
a block boundary of the received decoded image using 35 P'^'^^' ""^^ ^ ^^"7"^ coefficient and bUm- 
a first filtering coefficient when the decoded image is a early interpolatmg the pixels withm a block, if the 
planar surface; decoded image is a planar surface; and 

(b) obtaining second correction values by filtering pixels (c) providing a corrected image by correcting the received 
on a block boundary of the received decoded image decoded image using the obtained correction values, 
using a second filtering coefficient when the decoded 40 method of claim 9, wherein in step (a); the 
image is a complex surface; and received decoded image is determined to be a complex 

(c) providing a corrected image by correcting the received ^^^^^^ ^ ^^'^ non-zero coefficients other than a DC 
decoded image using the first correction values when coefficient and at least some low-frequency coeffiaents 
the decoded image is a planar surface or using the among discrete cosine transform coefficients for decoded 
second correction values when the decoded image is a 45 f ^^^^^^^^ f ^ otherwise the received decoded image is 
complex surface. determmed to be a planar surface. 

2. The method of claim 1, wherein in step (a) the first , ^ V"^ ^^^"^ ^^^^^^^ ^° ^^^P assuming 
correction values are correction values for pixels on a block ^ i^'^^ «^ P^^*^ spanning across two blocks are . . . , Al, 
boundary ' * Bl, . . . , and a block boundary is placed between 

3. The method of claim 2, wherein, assuming that a line 50 ^^.^ ^^'^^"^6 coefficient for obtaining cor- 
of pixels spanning across two blocks arc denoted by . . . , Al, f'^^^'^J.f P'f ^"'^ ' .^^""^^ boundary is 
AO, BO, Bl, . . . , and a block boundary is positioned between ^^J^> '^^^"^^ ^^"^l ^ ^ ^^^^ 
AO and BO, the first filtering coefficient for obtaining first ^'^^^^ g^^^" respectively to the correcUon values for AO 
correction values for two pixels AO and BO on the block !L ^ , 

boundary is [1/4, -3/4, -1/4, 3/4], a negative sign and a 55 °^ ^1^"° ^^^^ compnsmg the steps 
positive sign being assigned to the first correction values for 

AO and BO respectively. (d) obtaining correction values for at least some pixels on 

4. The method of claim 2, wherein the step (a) further a block boundary by filtering block boundary pixels of 
comprises a step (al) of obtaining correction values for received decoded image using second filtering 
pixels within a block by bilincariy interpolating pixels 60 coefficients when the received decoded image is not a 
within the block using the correction values for the block planar surface; and 

boundary pixels. (c) providing a corrected image by correcting the received 

5. The method of claim 1, wherein , assuming that a line decoded image using the correction values obtained in 
of pixels spanning across two blocks are . . . , Al, AO, BO, step (d). 

Bl, , . . , and a block boundary is positioned between AO and 65 13. The method of claim 12, wherein, assuming that a line 

BO, the correction values for at least some block boundary of pixels spanning across two blocks are . . . , Al, AO, BO, 

pixels of the received decoded image are calculated in step Bl, . . . , and a block boundary is placed between AO and BO, 
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the correction values for at least some block boundary pixels 
of the received decoded image are calculated in step (d), in 
which the second filtering coefficient for obtaining correc- 
tion vahics for the boundary pixels AO and BO is [1/8, -3/8, 
-1/8, 3/8], so that a negative sign and a positive sign are 
given respectively to the correction values for AO and BO, 
and in which the second filtering coefficient for obtaining 
correction values for the boundary pixels Al and Bl is [1/24, 
-1/8, -1/24, 1/8], so that a positive sign and a negative sign 
are given respectively to the correction values for Al and 
Bl. 

14. A de -blocking apparatus for de -blocking a received 
decoded image obtained by decoding a block-based coded 
image, the apparatus comprising: 

a block classifier for determining whether the received 
decoded image is a planar surface or a complex surface; 

a first correction value calculator for calculating correc- 
tion values for block boundary pixels by filtering the 
block boundary pixels of the received decoded image 
using a first filtering coefficient when the decoded 
image is a planar surface; 

an interpolator for providing first correction values for 
pixels on the block boundary, and within a block by 
bilineariy interpolating the pixels within a block using 
the correction values for the block boundary pixels; 

a second correction value calculator for calculating sec- 
ond correction values for at least some block boundary 
pixels by filtering the block boundary pixels of the 
received decoded image using a second filtering coef- 
ficient when the decoded image is a complex surface; 
and 

a corrector for providing a corrected image by correcting 
the received decoded image using the first correction 
values when the received decoded image is a planar 
surface or using the second correction values when the 
received decoded image is a complex surface. 

15. The apparatus of claim 14, wherein the block classifier 
generates a block classification control signal for classifying 
the received decoded image as a complex surface if there are 
non-zero coeflScients other than a DC coefficient and some 
low-frequency coefficients among discrete cosine transform 
coefficients for decoded image blocks, and otherwise, clas- 
sifying the received decoded image as a planar surface. 

16. The apparatus of claim 15, further comprising a 
selector for providing the first correction values to the 
corrector when the received decoded image is classified as 
the planar surface by the block classification control signal, 
and providing the second correction values to the corrector 
when the received decoded image is classified into the 
complex surface. 

17. The apparatus of claim 14, wherein in the first 
correction value calculator, assuming that a line of pixels 
spanning across two blocks are . . . , Al, AO, BO, Bl, . . . , . 
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and a blodc boundary is placed between AO and BO, the first 
filtering coefficient for obtaining correction values for pixels 
AO and BO on a block boundary is [1/4, -3/4, -1/4, 3/4], and 
a negative sign and a positive sign are given respectively to 
5 the correction values for AO and BO. 

18. The apparatus of claim 14, wherein, assuming that a 
line of pixels spanning across two blocks are . . . , Al, AO, 
BO, Bl, . . . , and a block boundary is placed between AO and 
BO, the correction values for at least some block boimdary 
10 pixels of the received decoded image arc calculated by the 
second correction value calculator, in which the second 
fihering coefficient for obtaining correction values for the 
boundary pixels AO and BO is [1/8, -3/8, -1/8, 3/8], a 
negative sign and a positive sign being given respectively to 
15 the correction values for AO and BO, and in which the second 
filtering coefficient for obtaining correction values for the 
boundary pixels Al and Bl is [1/24, -1/8, -1/24, 1/8], a 
positive sign and a negative sign being given respectively to 
the correction values for Al and Bl, 
20 19. A method of de-blocking a received decoded block- 
based coded image, the method comprising: 

determining whether the decoded image is a planar image 

or a complex image; 
calculating first correction values when the decoded 

image is a planar surface; 
calculating second correction values when the decoded 

image is a complex surface; 
correcting the received decoded image using the first 
correction values when it is determined that the 
decoded image is a planar image; and 
correcting the received decoded image using the second 
correction values when it is determined that the 
decoded image is a complex image. 
35 20. A method as set forth in claim 19, further comprising 
performing two-dimensional interpolation on the decoded 
image when it is determined that the decoded image -is a 
planar image. 

21. A method as set forth in claim 19, wherein said 
4Q determining operation comprises determining whether cer- 
tain coefficients corresponding to a discrete cosine transfor- 
mation (DCT) of the decoded image are non-zero. 

22. A method as set forth in claim 21 wherein said 
determining operation further comprises: 

45 determining that the decoded image is a complex image if 
the discrete cosine transformation (DCT) has a non- 
zero coefficient corresponding to an AC component 
other than the two lowest-order AC components; and 
determining that the decoded image is a planar image if 

50 the discrete cosine transformation (DCT) does not have 
a non-zero coefficient corresponding to an AC compo- 
nent other than the two lowest -order AC components. 

* * * * * 
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